Gated-Attention Readers for Text Comprehension

نویسندگان

  • Bhuwan Dhingra
  • Hanxiao Liu
  • Zhilin Yang
  • William W. Cohen
  • Ruslan Salakhutdinov
چکیده

In this paper we study the problem of answering cloze-style questions over documents. Our model, the Gated-Attention (GA) Reader1, integrates a multi-hop architecture with a novel attention mechanism, which is based on multiplicative interactions between the query embedding and the intermediate states of a recurrent neural network document reader. This enables the reader to build query-specific representations of tokens in the document for accurate answer selection. The GA Reader obtains state-of-the-art results on three benchmarks for this task–the CNN & Daily Mail news stories and the Who Did What dataset. The effectiveness of multiplicative interaction is demonstrated by an ablation study, and by comparing to alternative compositional operators for implementing the gated-attention.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The Effect of Self-Regulation on Improving EFL Readers’ Ability to Make Within-Text Inferences

Self-regulation is the ability to regulate one’s cognition, behavior, actions, and motivation strategically and autonomously in order to achieve self-set goals including the learning of academic skills and knowledge. Accordingly, self-regulated learning involves self-generated and systematic thoughts and behaviors with the aim of attaining learning goals. With that in mind, this study aimed to ...

متن کامل

Problem-solution Structures in Persuasive Texts: Effects on Attention, Comprehension, and Yielding

This study addresses the question of how problem-solution structures influence the processing of persuasive texts. In Experiment 7, 48 students read ads containing problem, solution, and company information on a computer. The position of the company information was varied: It came either before the problem and solution, between these two parts, or after them. Ads starting with problem informati...

متن کامل

87 - 52 Text Organization and Comprehensibility in Technical Writing

Technical texts often introduce scientific principles by deriving the principle prior to stating the principle itself. This "proof-first" organization violates writing guidelines suggested by current text learning theories. The current research compared the effects on comprehension of this type of structure with its logical alternative, a "principle-first" structure. Results indicate that reade...

متن کامل

High-Performing Readers Underestimate Their Text Comprehension: Artifact or Psychological Reality?

We focused on the controversy whether high-performing readers consistently underestimate their comprehension or are prone to detrimental overestimations as much as less skilled readers are. Therefore, we conducted an experiment (N = 105 university students) to investigate judgment bias as a function of reading skill and text difficulty in terms of text cohesion. Results showed that the easy tex...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017